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perfonrance  in  Air  Force  applications.  Most  of  the  woidc  described  was 
perfonned  by  students  inidef  the  direction  of  Professors  A.  Klinger, 

D.  Martin,  and  J.  Vidal,  and  documented  in  Master's  and  Doctoral  theses. 

Major  portions  of  the  work  were  concerned  with  theoretical  studies  of 
image  processing,  pattern  recognition,  and  ccaiputer  models  of  unknown 
systeiTS  (identification) .  however,  some  studies  investigated  design  of 
reliable  logical  hardware,  coputer  software,  and  multiprocessor  resource 
allocation  modes. 

Tlie  report  consists  of  this  introduction,  a  general  description  of 
the  I’esearch,  a  detailed  section  on  the  specific  research  topics  and  results, 
and  sections  on  conclusions  and  further  woric,  student  support,  and  publications. 
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This  report  SEiiretiarizes  the  results  of  a  tworyeaf  research  program  undertaken  to 
investigate  aspects  of.  ’eliability  of  computer,  systems  particularly  with  regard 
to  theoretical  aspects  of  their  design  and  performance  in  Air  Force  application^. 
Most  of  the  work  described  was  per.fori.ied  by  students  under  the  direction  pf 
Professors  A.  Klinger,  D,.  Martin,  and  j.  Vidal,  arid  documented  in  Master's  and 
Doctoral  theses,  ilajpr  portions  of  die  work  were  concerned  with  theoretical 
studies  of  image  processing,  pattern  recognition,  and  computer  models  of  unknown 
systems  (identification).  However j  some  studies  investigated  design  of  reliable 
logical  hardware,  computer  software.,  and  multiprocessor -resource  allocation  .modes , 
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II.  RESI-IARCH  DESCilimOK 


Ihree  types  of  research  were  conducted: 

1)  pattern  recogjiitlon,  imacs  processing,  and  system' 

identification 

2)  softwai«  systems  and  logic  design,  and 

3)  models  of  reliability  and  performance. 

In  the  first  category,  two  inportant  classes  of  Air  Force  applications 
were  defined:  continuous  tine  signal  data  -and  pictorial  data.  Research 
was  conducted  on  inproving  methods  for  I’epresentlng  data  fran  both  classes 
for  conputer  processing.  Continuous  sigial  data  arises  in  radar,  cormrunications , 
and  surveillance  by  sensors  as  well  as  in  analog  and  hybrid  simulation. 

Pictorial  data  is  obtained  by  photo-optical  means  in  Air  Force  reconnaissance 
missions.  Specific  problems  often  yield  insight  into  general  characteristics 
of  these  classes  of  data.  Hence  research  was  conducted  in  areas  sometimes 
ranging  to  diverse  applications  such  as  biomedical  image  processing.  General 
properties  discerned  lixOT  this  research  were  developed  and  presented  In  other 
publications.  Comnonallties  to  objectives  such  as  search  and  storage  of 
visual  scenes  were  found  so  that  the  researcl-i  enhanced  the  central  goal  of 
the  project.  The  subjects  of  pattern  recogjtLtion  and  system  Identification 
are  discussed  in  greater  detail  in  Section  III,  Specific  Research  Topics 
and  Results. 

The  second  category  began  with  an  intensive  effort  to  introduce 
redundancy  in  digital  logic  design  in  a  way  tliat  would  best  inprove  overall 
system  reliability  (lower  probability  of  failure),  A  sindlar  softvrare  effort 
was  conducted  lo  examine  ueadlock.s  in  a  parallel  processing  system.  Ihe 
former  effort  examined  intixoduction  of  cptimal  redundant  allocations  of  logic 


elements  while  the  latter  Involved  a  cotiparisori  of  simulation  model  results 
with  actual  jneasux'-emsnts  on  a  large  con^iuter, 

A  probabillty-^nodel  theoretical  investigation  of  memory  space  and  central 
processor  time  allocations  and  their  effect  on  "failure"  measures  such  as 
page  faulting  concludes  the  research  conducted  here.  This  effort  is  related 
to  the  second  category  but  deserves  its  own  descriptive  heading  under  models 
of  reliability  and  performance. 

A  conncn  aspect  of  all  the  research  conducted  vjas  the  use  of  statistical 
models.  Likewise,  the  conputer  systems  which  were  modeled  were  found  to 
require  additional  Interactive  processing  in  order  to  further  the  research 
objectives.  Ihls  was  reflected  first  in  the  proposal  which  resulted  in  the 
new  APOSR  Grant  72-238^ ,  and  the  development  of  a  set  of  hardware  criteria 
vMch  led  to  the  purchase  of  IMLAC  equlpnant  which  has  been  installed  in  a 
laboratory  facility  Jointly  used  by  ProfesS'  >i'v-  J.  Vidal,  W,  Karplus,  and 
A.  Klinger  and  their  research  students.  (Ihe  purchase  was  partially  stpported 
by  APOSR  70-1915  and  partially  by  NSF  GJ  32221.) 
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III.  SPECIFIC  RESEARCH  TOPICS  >\ND  RjiSULTS 


The  overall  objecti\^  of  the  researcli  program  v;as  to  isolate  ways 
in  whicl)  design  and  performance  reliability  of  Air  Force  conputers  could 
be  iirproved.  At  the  cormencement  of  the  project  it  was  believed  that  a 
cojTbination  of  new  optlMzation.  methods  with  probabilistic  propei’ties 
of  redundancy  (introduction  of  additional  logic  elements)  could  introduce 
desigri  reliability  improvements.  It  was  also  believed  that  several 
perfonnance  objectives  could  be  iirproved  by  adapting  pattern  recogjrition 
theoi:y  to  applications  and  by  utilizing  piecewise  continuous  probability 
laws  in  modeling  actual  failure  rates.  In  all  these  cases  the  theoretical 
capability  existed  and  the  need  was  for  ad^ting  that  theory  to  conputer 
realities  through  creation  of  software  -  l;je._,  conputer  programs .  Tills 
goal  of  program  development  sou^t  to  create  working  tools  for  testing  the 
theoretlcai.  concepts  applicability  to  the  contenporary  needs  in  the  areas 
of  reliability  of  conputers  vMch  we  Investigated,  namely 

1)  pattern  recogiition,  image  processing,  and  system  identification, 

2)  software  systems  and  logic  desigi,  and 

3)  models  of  reliability  and  performance. 

In  actuality,  program  development  acconplishments  were  constrained  by  a 
conbination  of  conputer  hardware  limitations.  Nevertheless  applied  and 
theoretical  advances  were  made  in  all  three  ai'eas.  Eliphasis  was  placed 
on  use  of  the  UCLA  canpus  conputing  large  conputer  (IBM  360/91)  and  small 
conputers  already  In  the  Ccxiputer  Science  Department  laboratories,  in 
pairticular  an  XDS  920  conputer.  Both  systems  were  used  advantageously, 
the  first  on  all  three  areas,  and  the  second  In  iirage  processing  applications. 


Tiie  woii<  on  pattern  recognition,  image  processing,  and  system 
id?ntiflcation  consisted  of  several  diffci’ent  activities  united  by  the 
goal  of  finding  ways  to  b-Jtter  use  coiqDuters  in  ajjplied  contexts.  A 
general  principle  in  pattern  recogxiition  is  the  descirlption  of  data  by 

p 

features.  A.  Klinger,  A.  Kochman  and  N.  Alexandridis '  developed  an 
hierarchical  irethod  for  defining  features  to  correspond  to  the  current 
decisicn-level  for  chromosaie  slide  pictures.  The  principles  are  applicable 
to  any  two-diiiensional  image  data.  This  work  was  conplemsnted  by  analyses 
done  by  A.  Klinger  and  H.  Suglyaita  re  sequential  accumulation  of  radioisotope 
scanning  information  which  were  simulated  by  I.  Rynell  in  her  M.S.  thesis 
research.  Some  preliminary  results  of  that  work  v/ere  published  in  a  paper 
by  I,  Rynell  and  A.  Klinger^.  The  general  concept  of  defining  features  or 
Intensively  scanning  hl^  interest  areas  in  an  image,  according  to  the  kind 
of  decision  that  the  conputer  must  make  is  a  practical  way  to  view  the  problem 
of  pictorial  pattern  recognition. 

A  parallel  activity  Involved  introducing  these  concepts  into  general 
planning  and  decision-making  ccntexts.  At  an  applied  level,  S.  Ramadorai 
and  T.  Llneck  each  used  these  sequential  decision  concepts  In  M.S.  thesis 
research  involving  radar  data  processing.  N.  Chin  introduced  a  set  of 
software  processing  functions  for  one-dLiensional  (e.g.  continuous  time) 
signals  which  extracted  the  presence  of  significai'\t  features  in  the  data,  as 
part  of  his  M.S,  thesis  research.  ,A,  Klinger  presented  these  aspects  of 
sequential  search  in  medical  pattern  reco^iition  problems  at  the  Joint  National 
Caiferenoe  on  Major  Systens^'^  and  extended  tne  sequential  seai’ch  and  feature 
extraction  concepts  to  the  theoretical  planning  and  ds^lsior>-making  level  in 
a  pibllahed  paper^  (E.  Pui’cell  aided  in  the  construction  of  a  table  vMch 
aprK'ars  tl-jerc). 


An  I’rportant  aspect  yf  feature  extraction  is  the  basis  or  donain 

of  representation  of  the  signal.  In  an  early  paper^  A.  Klinger  suggested 

a  difference-differential  equation/generating  function  approach  to  representation 

of  solutions  to  partial  diffei’ential  equations.  Later,  the  representation 

of  qualitative  phononena  seened  to  be  critical..  Hence  the  reseaixjh  inves- 
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tigated  notions  of  boundary  shape:  a  publication  and  a  presentation  to 
the  Joint  National  Conference  on  r-lajor  Systens  by  A.  Klinger  viere  related 
to  this  question. 

At  the  same  time  N.  Alexandridis  was  conducting  doctoral  research 
regarding  L.age  processing  vMch  led  to  a  Ph.D.  thesis,  sevei’al  publications, 
and  a  patent  application.  The  woric  done  here  involved  aspects  of  feature 
extraction  and  pattern  recognition  as  the  publication  by  N.  Alexandridis  and 
A. Klinger'  and  by  N.  Alexandridis  indicate.  Several  of  the  main  contributions 
of  that  thesis  concern  representation  of  one  and  two-dinensional  patterns  with 
respect  to  the  Rademacher-Walsh  functions,  a  conplete  orthononnal  basis  (the 
approach  in^  suggested  a  nonorthogonal,  easily  conputed  set).  Tlie  patent 
application  concerns  the  possibility  of  b-.'llding  hardware  devices  to  facilitate 
obtaining  a  Walsh-Hadamard  transformatior  of  a  two-dliiensional  picture  in  real¬ 
time  -  i.e. ,  a  representation  of  the  pictire  in  an  expansion  with  respect  to 
two-dimsrslonal  Rademacher-Wjilsh  functions.  Soriie  aspects  of  this  were  discussed 

O 

in  the  paper  published  by  N.  Alexandridis  and  A.  Klinger®  while  the  basic 

theoretical  interconnections  between  the  natural  Walsh-Hadamard  Fourier  series 

l5 

representation  order  and  the  pattern  axis-symmetry  order  were  published  by 
N.  Alexandridis.  That  image  processing  research  is  closely  related  to  pattern 
recogTltion/feature  extraction  is  su^^^sted  by  the  M-r.ters  degi\.-e  work  done 
by  P.  Topping  \dio  created  software  for  image  scanning  which  localized  the  scan 
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in  z';nes  of  hlf^i  interest:  a  partial  iKplementat3.on  of  the  pictiu^  data 

Tj 

structure  suggested  in  the  thsoi-stical  pat  tom  search  paper*^  by  A.  Klinger. 
Further  discussiai  which  indicates  how  the  partial  or  localized  scan  can  be 
used  prior  to  Walsh-Hadamard  transformation  to  yield  inproved  transmission  of 
infonnative  parts  of  a  visual  scene  will  be  found  in  the  next  section. 

System  identification  research  requires  knowledge  of  the  ninrher  of 
Independent  inodes  or  phenomena  in  a  signal.  J.  Vidal  supervised  doctoral 

research  by  D.  Schwartzmann  which  addressed  the  topic  of  intrinsic  dirmnsionality. 
This  relates  to  how  many  terms  in  a  Fourier  expansion  or  hov;  many  featur-es  are 
needed  to  adequately  model  an  unknown  system.  J.  Vidal  and  D.  Schwartzmann 
published  a  paper  describing  their  use  of  clustering  considerations  to  resolve 
topologically  related  data.  D.  Sciiwartzmann  (like  N.  Alexandrldis)  conpleted 
his  Ph.D.  work  and  received  tJie  degree. 

Parallel  applied  efforts  in  system  modeiing  and  pattern  recognition  were 

part  of  the  research.  These  include  a  Master's  thesis  by  K.  Doane  on  speech 

.recogiltlon  and  Ph.D.  research  by  S.  Saib  on  speech  recognition,  in  the  realm 

of  COTtinuous  signal  processing.  W,  ffeyers  conpleted  a  M.S.  thesis  on  credit 

card  verification  by  conputerlzed-fin^rprint  matching.  D.  Zwelban  created 

conputer  programs  for  chrcHnosome  scene  processing,  conputer  interfacing,  and 

Interactive  signal  precessing,  as  well  as  an  M.S.  research  project  on  learning 

autonata  and  patterns.  A.  Klinger  was  consulted  on  drug  treatment  data  pattern 
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analysis  by  J,  Satterfield  and  they  published  a  paper  together.  A.  Klinger 
organized  a  Workshop  on  Decision-Analysis  at  the  Joint  National  Conference 
'  on  Major  Systems^^  vMch  dealt  wdth  related  questions  of  pattern  and  decision 
analysis  for  qualitative  probleirs.  M.  ilee  completed  her  M.S.  project  an  a 
decision-analysis  problem. 


Work  on  softwaix?  systeins  and  logic  design  was  tnost  proud nent  in  the  initial 
stages  of  the  grant  research.  M.  Tam  created  interactive  design  programs  for 
introducing  redundancy  in  a  digital  logic  net  to  optimally  increase  probability 
of  success  (of  some  path  functioning  to  iirolement  a  given  logic  expression). 

I-ie  did  not  conplete  this  research,  however,  and  he  is  ncM  eiiployed  in  industry. 

14 

D.  I-Iartin  published  a  paper  on  Boolean  natrix  conputations  of  precedence  . 

In  addition,  he  supervised  the  f^ters  degree  research  of  S.  Mrithunjayan 

whose  thesis  concemed  a  key  software  system  problem  in  parallel  processing, 

that  of  deadlock.  Mrithunjayan  simulated  operation  of  the  360/91  system  at 

UCLA  and  conpared  his  results  to  ireasured  data.  J.  Rao  has  been  advanced  to 

candidacy  for  the  Fn.D.  on  the  basis  of  his  research  on  the  two-resource 

allocation  problem  in  parallel  processing  (conputer  tnemoiy  and  processor  time): 

be  has  been  working  with  A.  Klinger  and  is  expected  to  conplete  his  thesis 

in  1972.  D.  Hibbits  and  F,  Kamoun  have  been  working  on  software  vdth  O'.  Vidal. 

Woiic  on  models  of  reliability  and  performance  Include  aspects  of  the 

above-mentioied  research  by  Mrithunjayan  and  Rao.  In  addition  J.  Rao  published 
17 

a  note  on  hazard  rate  functions.  Likewise  major  reliability  and  performance 
research  was  lnclude,d  in  the  M.S,  thesis  by  I.  Rynell,  which  introduced  new 
likelihood  ratio  decision  rules,  that  by  S.  Ramadoral,  which  calculated  in 

detail  nrobablllty  of  detection  for  different  radar  dlgital-winda,;  sizes  and 
threshold-detection  algoi’lthms,  that  by  T.  Lineck,  and  the  paper^  by  A.  Klinger 
which  discussed  reliable  search. 
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IV.  CONCLUSIONS  :ua}  FUKim*^i  \m 


llie  ovsrall  two-yeai’  research  progi:*am  fulfilled  its  primary  objectives. 

A  nunber  of  areas  were  found  vriiere  existing  theory  could  be  applied  to  conputer 
desi0i  and  performance  reliability  problems,  and  aspects  of  existing  theory 
were  isolated  which  need  extension  to  enable  practical  use  of  computer  power 
in  operational  contexts.  At  the  same  time  a  substantial  number  of  graduate 
students  received  valuable  training  and  experience.  One  student  remarked 
that  the  project  he  pursued  gave  him  his  first  experience  vdth  a  Hands-on 
digital  cortputer.  Several  undergraduate  students  received  support  for 
prograiming  and  research  assistance.  One,  A.  Kochman  (nw  a  computer 
progranining  consultant),  coautbored  a  paper  and  made  a  presentation  at  a 
national  conference.  Limitations  on  existing  conputer  hardware  at  UCLA  and 
increased  enphasis  on  interactive  conputation  and  display  led  to  the  decision 
to  seek  added  equipnent. 

Plans  for  future  research  include  applying  the  equipment  which  is  now 
Installed  (an  IfiLAC  Progranmable  Display  System)  in  several  modes.  One  goal 
is  to  direct  a  picture  scan  to  areas  of  hJ.^  information  content  so  that 
transformation  (e.g.  FFT  or  Fast  Fourier  Transformation,  V/alsh-Hadamai’d,  etc.) 
and  transmission  or  storage  of  the  result,  can  be  performed  in  great  detail 
where  there  is  inpoi1;ant  data  and  in  less  detail  where  tiiore  is  none.  I.e., 
more  term  would  be  retained  in  the  truncation  of  the  infinite  series  obtained 
from  transforvnaticxi  vrtiers  there  is  pictorial  information  content,  less  te^rms 
retained  where  there  is  none,  yet  the  total  amount  of  Fourier  coefficient  data 
obtained,  stored,  and  transraltteQ  would  be  the  same  as  in  standard  picture 
processing  techniques. 


ll'ie  work  lias  eiqierienced  a' general  shil't  ta-iai-d  pattern  recognition, 
decision  analysis,  and  statistical  approaches  to  planning.  This  will  involve 
extensions  in  the  areas  of  pattern  search,  hierarchical  decisions,  and 
qualitative  data.  Subjective  measures,  statistics  of  I’anlc  order  data,  and 
multilevel  weighting  and  data  incorporation  are  all  topics  which  need  to  be 
ejplored.  Man-inadiine  interaction  via  visual  displays  and  graphic  input 
vdll  be  needed  in  future  investigations. 
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V.  STUDENT  S.tJFPOiRt 


fectdra^l  Students; 

t»  Ki  Alcxandridis*.  Ph.D.  dissertation,,  "Walsh-Hadamard  Transformation 

in  inage  iProcoss.ing/’-’  conrpl^gd  „Tublished  aa  UCiA  Engineering 

Report  No.  ilrrOS,  (portions  published  as  "The  ilndajnard  Transform  in 
linage  Trocessing  and  Pattern  Recognition,"  UCLA  Engineering  Report  No. 
70-11,  1971).  Currently  with  Ultrasystems,  Newport  Beach,  California. 

2,  J,;  Rao,  Ph,D.  dissertation,  "Analytic  Models  for  Allocation  of  Computer 
Memory  and.  Processor  Time,"  to  be  completed  in  1972.  Currently  Post 
Graduate  Research  Engineer  at  UCLA. 

3.  p.  Schwartzmantij  Ph.D.  dissertation,  "Black  Box  System  Identification 
via  the  Topological  Dimensionality  Approach  with  Applications  to 
Neurophysiological  Problems,"  completed  in  1972.  Currently  Post 
Graduate  Research  Engineer  at  UClA* 

A.  M.  Tam,  did  not  complete  d^pctpral  dl8§ertatlpn  reaearch, 

>fester*8  Students; 

1.  M.  Hee 

2.  D.  Hibbits 

3.  F.  Kamoun 

A.  W.  Meyers 

5«  S.  Krithunjayan 

6.  E>.^  Purcell 

7.  S.  Ramadorai 

8.  T.  Rynell 

9.  D.  Zweiban 

Undergraduate  Assistants; 

1.  M.  Alperin 

2.  A.  Kochman 

3.  G.  Roy  ’ 

A.  D.  Sekiguchi 

5.  C.  Smith 


^ia8ter's  Studento  Decree  Rasearch: 
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